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Description 

[0001] The present invention is directed to cataloging 
of digital images. More particularly, the software and 
system for cataloging digital images into an electroni- 5 
cally stored collection or library. 

[0002] Photographs are taken for a variety of personal 
and business reasons. During the course of the year an 
individual may take numerous photographs of various 
events. During these events, quite often there is a vari- 10 
ety of different individuals and items present in these 
photographs. In the prior art, when one desires to cata- 
log these images in a particular order, they usually are 
left to placing these images manually into photograph 
albums. This is a very extensive, manual procedure re- is 
quiring a significant amount of time. In addition, it is very 
limited with regard to the amount of information that can 
be associated with the image in a quick and easy man- 
ner. While some photo albums allow the writing and 
placing of text, the entering of this data is a very time 20 
consuming and arduous affair. Once- having sorted 
these images into particular albums which may repre- 
sent categories of interest, it is extremely difficult to re- 
trieve' and/or reorganize the images into other catego- 
ries! With the advent of digital cameras and digital im- 25 
aging, it is known that these images can be stored in 
databases. However, there is no easy and quick or effi- 
cient way for cataloging of these images; retrieving and/ 
or reorganizing these images. * 
[0003] Applicants;have invented an efficient method 30- 
and system for organizing digital images in a quick and 
efficient manner. The organized images ca : n be easily 
retrieved and reorganized by a variety of criteria. 
[0004] In accordance with one aspect of the present 
. invention there is provided a computer software product 35 
comprising a computer readable storage medium hav- 
ing a computer program which when loaded into a com- 
puter of an image forming device causes the computer 
to perform the following steps: 

■40 

displaying at least one image for categorization; 
providing at least one selection category having at 
least one image association icon that can be asso- 
ciated with the image to be reviewed. 

• - 45 
[0005] In accordance with another aspect of the 
present invention there is provided a method fororgan T 
izing a plurality of images comprising the steps of: 



|0006] In accordance with yet another aspect of the 55 
present invention there is provided a computer software 
product comprising a computer readable storage medi- 
um having a computer program which when loaded into ' 



a computer of an image forming device causes the com- 
puter to perform the following steps: 

- retrieving at least one image from a plurality of im- 
ages that have been previously categorized; 
providing at least one selection category having at 
least one image association icon that can be asso- 
ciated with the image to be reviewed. 

[0007] In accordance, with still another aspect of the 
present invention there is provided a method for person- 
alizing an image computer software program, compris- 
ing the steps of: 

a. providing a categorization/retrieval program that 
uses categories and image icons for use in catego- 
rizing and/or retrieving digital images; 

b. selecting from a plurality of stored categories at. 
least one selection category; and 

. c. selecting from a plurality of stored image icons at 
least one image icon for use with at least one se- 
lection category. - ' 

.[0008] In accordance with another aspect of the 
present invention there is provided' a method for retriev- 
ing an image from a plurality of images that have been 
previously categorized, comprising the steps of: 

"- retrieving at least one image. from a plurality of im- 
: ages that been previously categorized; 

providing at least one selection category having at- 
least one image association icon that can be asso- 
ciated, with the image to be reviewed. 

[0009] In accordance with yet still, another aspect of 
the present invention there is provided a method for au- 
tomatically organizing a plurality of images comprising 
the steps of: 

providing at.least one image icon associated with a . 
category, 

using predetermined characteristics of the icon for 
use in identifying non-categorized images for asso- 
ciation with the category. 

[0010] In accordance with . another aspect of the 
present invention there is provided a computer software 
product. for automatically categorizing images compris- 
ing a computer readable storage medium having a com- 
puter program which when loaded into a computer of an 
image forming device causes the computer to perform 
the following steps: 

providing at least one image icon associated with a 
category, 

• using predetermined characteristics of the icon for 
•use in identifying non-categorized images for asso- 
ciation with the category. 



displaying at least of the plurality of images; ■ 50 

categorizing at least one of the plurality of images 
using an image icon for at least one selection cate- 
gory.' 
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[001 1] The above, and other objects, advantages and 
novel features of the present invention will become more 
apparent from the accompanying detailed description 
thereof when considered in conjunction with the follow- 
ing drawings. 5 
[001 2] In the detailed description of the preferred em- 
bodiments of the invention presented below, reference 
is made to the accompanying drawings in which: 

Fig. 1 is a schematic diagram of a system for use in ' 10 
practicing the present invention; 
Fig. 2 is flow chart of the operation of a computer 
software program made in accordance with the 
present invention; 

Figs 3A-3H illustrates various display screens that is 
are developed as a result of the use of the software 
program made according to the present invention; 
Fig. 4 is a flow diagram of the how a new icon or 
test identifier may be added to the selection menu; 
and - 20 

Figs. 5A and 5B illustrate a display screen a modi- 
fied form of the present invention. 

[0013] Referring to Figure 1 there is illustrated a sys- . 
tern 10 made in accordance with the present invention. -25 
The system includes a computer 12 for processing data 
and information. The computer 12 also includes an ap- ; 
propriate processor and memory storage for the running . ■;; 
of software programs and storing of digital data as is 
customarily done by computers. In the embodiment il- ' -3o : 
lustrated, computer 12 is a persona! computer having a <■ 
display device 14 which in the particular embodiment is 
a CRT. The computer 12 also includes input devices 16 
and 1 8 for entering of data into the computer 1 2 by the 
user. In particular, input device 16 is a keypad and input 35 
device 18 is a mouse. However, it is to be understood 
that any input device or means may be employed, for 
example, but not by way of limitation to, a voice recog- 
nition system. A scanner 20 is provided for scanning of 
hard copy images for obtaining digital files of images. 40 
The scanned images are digitized and -forwarded to 
computer 12 as is well known in the art. Computer 12 is 
also provided with appropriate communication hard- 
ware and software, as is well known in the art, for allow- 
ing communication with third parties. In the embodiment *5 
illustrated, the communication hardware and software 
allows communication to. an -internet service provider.- 
ISP 22 which in turn allows communication with the in- 
ternet 24. The internet 24, as is well known, allows elec- 
tronic communication with various other parties. The so 
system 10 also includes a photoservice provider 26 ca- 
pable of providing digital imaging goods and/or services. 
These goods and services may be requested by cus- 
tomers over the internet 24 or by any other means, for 
example, but not by way of limitation through the use of- -55 
order envelopes containing image products having im- ■ 
ages thereon. The ordered goods and/or services may 
be provided to the customer- over the internet 24 or by 



forwarding such goods and/or services directly to the 
customer through the mail, or other delivery system. As 
is illustrated, a third party 28 may also be connected to 
internet 24 .for communication with others that are con- 
nected to internet 24. 

[0014] Referring to Figure 2, there is illustrated a flow 
diagram of the operation of a computer software pro- 
gram made in accordance with, the present invention. 
The software program is designed such that when load- 
ed onto a computer, it will cause thecomputerto perform 
the steps set forth in Figure 2. In particular, the first step 
30 of software program allows the user to obtain digital 

■ images from any appropriate source. For example, as 
illustrated by Figure 1, digital images may be obtained 
by scanning of images by the user, or from a digital de- 
vice such as a digital camera, or from a stored digital 
data file on the computer 12. Alternatively, the images 
may-;be obtained from the third party 28. over a commu- 
nication network such as the Internet 24. For example, 
a roll of photographicfilm may have been sent to service 
provider 26 where .the film would have been developed 
and digitally scanned so. as to provide a digital record of 
the. images contained thereon. The scanned. digital im- 
ages would then be forwarded to the. user over the in- 
ternet 24 and ISP 22 allowing access by the user at com- 
puter 12,- In- the next step 32, the selected images are 
reviewed and categorized. After completion of step 32, 

rthe-imagesatstep34are used as desired. For example, 
the categorized images-would be sent to a data storage 
file, to a. .third party, a service provider for obtaining de- 
sired goods and/ or services, or possibly to a printer. 
[0015] Referring to Figures 3A- 3G there is illustrated 
a. series .of computer display screens that illustrate the 
use of the computer software program of the present 
invention. Referring to Figure 3A there, is illustrated a 
computer screen which, illustrates one of the first 
screens viewed by the user when the program is acti- 
vated. In the particular embodiment illustrated there are 
various choices provided to the user. In particular, the 
user may obtain images by selecting item 1 in which 

. case, by selecting this item, options will be provided for 
the user. Forexample, obtaining images froma scanner, 
a digital camera 27 (see Fig. 1), from a third party source 
such as a service provider, friend, relative, or business 
associate, etc. It is to be understood that the digital im- 
ages may be obtained from any appropriate source. An- 
other option is to open an existing digital data file con- 

■. taining digital images. In. the embodiment illustrated, the 
user has selected the first option of obtaining a digital 
jmage on file. Figure 3B illustrates the first working 
screen 40 after the image or images that have been ob- 
tained and are ready for cataloging. As illustrated'by Fig- 
ure 3B, the initial working screen 40 has a working win- 
dow 41 in which the image or images to be cataloged 

. will be displayed. When a plurality of images are to be 
■ cataloged, the images will be sequentially displayed in 
window 41 until the user is done cataloging the selected 
images. As illustrated by Figure 3B. the first image 43 
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is illustrated in window 41. The working screen 39 in- 
cludes at least one selection category for categorizing 
of images. It is to be understood that any desired 
number of selection categories may be provided by the 
software program or created by the user. In the particu- 
lar embodiment, there is provided five (5) selection cat- 
egories 40, 42, 44, 46, and 48. .In particular selection 
category 40 is directed to "Who", meaning who are the 
individuals in the image 44 that are to be identified with 
the image. In selection category 40, there is provided a 
plurality of the image icons 50, 52, 54, and 56 for allow- 
ing the user to quickly and easily categorize the image 
44. In the particular embodiment illustrated, the icons 
50, 52, 54, 56 are individuals that are in some way 
known to the user. There is also provided a list of text 
identifiers 51, 53 and 55 which can also be used to as- 
sociate information with the image. The identifiers may 
correspond to the icons 50, 52, 54 and 56 if so desired. 
In the particular embodiment illustrated, icon 50 identi- 
fies individual name "Dan", icon 52 identified the indi- 
vidual "Sally", icon 54 identifies "Mom" and icon 56 iden- - 
tifies "Dad". It is, of course, understood that the various 
icons can be used to identify anyone or subject desired 
by the user. As discussed later herein, these individual 
icons may be personalized in accordance with the wish- 
es of the user. Thus, each of the icons can represent a ■■ 
name, a relationship, or any other desired reference. In 
the embodiment illustrated, the icons 50 - 56 each refer 
to individuals. However, these icons could have also re- 
ferred to groups of individuals. For example;' family, 
choir, co-workers, etc. Of particular interest is that the 
icons illustrated in selection category'40 are all person- 
alized according to the user and provide quick visual 
identification of the category. In the embodiment illus- 
trated, the icons are actually images of the individual 
identified as "Dan", "Sally", "Mom", or "Dad". Thus, if in 
the image 43 there is illustrated an image of "Mom" and/ 
or "Sally", in order to associate that information with im- 
age 43, the user would take an appropriate selection de- 
vice, for example, the use of a. mouse 18 or keyboard 
1 6 whereby a selection arrow will be placed over the two 
appropriate icons and selected. As illustrated in Figure 
3C, display window 50 displays the information that is 
to be associated with the image 43. In the embodiment 
illustrated, both text and visual icons with be associated 
with the image 43. As shown by Fig. 3C, the individuals 
"have been identified as "Joanne" and "Noah". This in- 
formation (meta data) is attached to the image file which 
can be used for searching and/or displaying of informa- 
tion when the images are later searched and/or dis- 
played.' 

[0016] An add button 49 is provided in association 
with selection category 40 so that new icons and/or text 
identifiers may be provided for selection by the user. For 
example, during viewing of an image in window 41, a 
. new individual may be viewed and the user wishes to 
associate this new individual with this image and possi- 
ble other images. By selecting the add button 49, an ar- 



row should show up on the image that would allow the 
user to identify an area of the image, for example, the 
portion of the image where this new individual is located. 
In Fig. 3C, the selected area is indicated by dash line 

5 57. Then the user can select that this area be created 
as a new selection icon for selection category 40. Alter- 
natively or in addition thereto, new text identifier by itself 
or in conjunction with the icon could be created. The new 
icon or text identifier can then be used in categorizing 

10 images provided in window 41 in the same manner as 
the other icons. 

[0017] Alternatively, add button 49 could initiate a di- 
alog box wherein a user could specify a specific location 
• or universal resource locator (URL) on the internet 24 

15 of a third party who provides pre-constructed icons with 
associated text identifiers for downloading into the soft- 
ware. These icons may be provided for a fee or they 
may be provided for free if the user provides some in- 
formation. The downloaded iconsare automatically as- 

20 signed to the proper selection category or if appropriate,* 
new categories are automatically created to contain the 
downloaded icons. . - 

[0018] Referring to Figure 3D, the "What" selection 
category 42 is selected by the user. Selection; category 
.- 25 42 has various icons which identify particular events and 
also a corresponding list 59 ; set forth. Any one. of the 
icons 58, 60, 62, 64 or selection items 63, 65, and 67, 
may be selected. As with selection box 40 there is the 
.ability to add additional information by the add button 70 
: 30 which operates in the same manner as button 49 previ- 
ously discussed. Once the appropriate selections have 
been made, the information associated with. the select- 
ed icons or text will be displayed in display window 80. 
[0019] The next selection category 44 in the particular 

35 embodiment illustrated is the "When". As illustrated by 
Fig. 3E, the "When" category comprises a category 
wherein a date may be entered. The date may be the 
date of capture of the image or the date when the user 
is using the program. In the embodiment illustrated, the 

40 date of manipulation of the image will be automatically 
entered if there is no previous date supplied. However, 
the date may be provided with the original image. For 
example, there currently exists the APS photographic 
system which uses a film strip having a magnetic layer 

45 upon which information can be provided by the camera 
that captures the image. Various types of information 
can be added by the camera that can used later in the 
■ photofinishing process. An example of such information 
is the date. This information can be maintained with the 

so image and when the image is digitally scanned by a 
serv j ce provider; the date recorded on the film can be 
associated with the image. The service provider may 
download the image to the user in which case the date 
downloaded can be imported automatically into the pro- 

55 gram used by the user. It is to be understood that any 
other pertinent data, may be added automatically to the 
cataloging program. For example, but not way of limita- 
tion, additional data may be provided on the scanned 
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film, provided by way of a digital camera, or even by a 
third party source such as the photofinisher. . 
[0020] Referring to Figures 3F, the next selection cat- 
egory 46 "Where" is illustrated. In the particular embod- 
iment illustrated there are four icons, 82, 84, 86, and 88 
which can be selected for association with the image in 
window 42. In addition, as previously discussed, a se- 
lection window having other information such as person- 
alized places can be added. For example, in the embod- 
iment illustrated by items 88 and 90, two additional plac- 
es are provided, i.e., Canada and/or Clinton, New York. 
The icons 82, 84, 86, and 88 respectively referto images 
or places directly associated to the consumer. For ex- 
ample, the first icon may represent a work location, the 
icon 84 can represent home, the third icon can represent 
a particular place or theme park that .was visited, and 
the last icon 88, could represent a relative's place. Once 
having selected the appropriate "Where", this is entered 
in and illustrated in display window 94. As previously dis- 
cussed, additional new items may be adde;d to the 
where category by the add button 96 which operates in 
the same manner as the other add buttons previously 
discussed. "' " ■ : 

[0021] In the particular embodiment illustrated, the 
last selection category 48 is "Why". Referring to' Figure 
3G, there is illustrated the reason why the people were 
gathered. In the particular embodiment illustrated, this 
is "Ma's and Pa's" 50 th anniversary party.- This informa- 
tion in the particular embodiment was manually entered 
and is illustrated in display window '94.; However, it is 
desired that appropriate icons could be personalized 
and added'for selection thereof. 

[0022] Figure 3H illustrates the screen whereby all the 
information will be kept as entered or revised and is 
shown by display screen 97. The data is retained by de- 
pressing the enter key on the keyboard 1 6 *or an equiv- 
alent button 101 provided on the screen. The next im- 
age, if there is one, would then be presented for cate- 
gorizing. A retain button 98 is provided so that the user 
can repeat the same selections made for the previous 
image for the image currently being displayed. If only 
some of the categories are to be the same for the next 
image, the retain button 98 can be selected and then 
editing of the desired category may be accomplished 
relatively quick and easy. Once'-the information has. 
been properly provided for all of the images, the images 
and associated information that has been entered is 
stored in a digital file or other appropriate digital memory 
storage device or location. Thus, anytime the image is 
reselected at a later time, the information, and search 
categories can-be accessed and used as desired as dis- 
cussed later herein. 

[0023] The icons used for selection categories may 
be icons originally provided with the software program, 
provided by a third party, and/or as illustrated above the 55 
icon can be created and personalized by the user. In a * 
similar manner, the selection categories may also be • . 
originally provided' by the software program, provided - '. 



by a third party and/or created by the user. This allows 
the user to be able to use the program as initially pro- 
vided or personalize the software program with the de- 
sired categories and icons specifically suited to meet the 
5 needs of the user. For example, the user would initially 
review a plurality of selection categories and image 
icons and select the desired categories and icon for use 
with the program. Additionally, during this initial set-up, 
personalized categories and/or icons may be added by 
10 the user as desired. Once the computer software pro- 
gram has been set-up, the categorization of images by 
the user can proceed. The present invention also allows 
the-user to modify the selection categories and/or icons 
at any time by use of the add button 49, 70, or 96 as 
15 previously-discussed. New categories and/or icons may 
be automatically provided by third parties or by other de- 
vices. For example, if an individual is using a camera at 
a theme park, meta data may be provided to the camera 
(digital or film-based) identifying a category and/or icon- 
20 which would be read by a photoservice provider, the cat- 
'• egory and/or icon in turn would be provided with the dig- 
!j- • ital image file. For example, a new icon providing an im- 
age of the theme park visited would be automatically as- 
sociated with each of the images captured at the theme 
. 25 park. If no. category or icon, is present in the software 
. ,.thatreads the icon and/or category, a new category and/ 
onicpn will be-automatically created by the software for 
.-. - ■ .-use with the current image and any further images used 

with .the software,. 
30-. ,[0024] • .The use of personalized icons and/or catego- * 
■ . ries allows for quicker.and easier association of the im- 
age and providing of meta data associated with the im- - 
ages. Further, the use of icons in the form of .an image 
allows quicker and easier-selection by the user as they . 
35 are readily recognizable by the user.and only require a 
simple click of a selection device to select. 
[0025] The following is brief description on how a user 
would use the categorizing software of the present in- 
• - vention.- In the beginning, userwould obtain the desired 
JO ■ image or images for categorizing. The images as previ- 
ously discussed may be obtained from any source. For 
example, as previously discussed, the images may be 
obtained from a roll of film that has been developed and 
scanned so as to provide a digital record of the images 
4$ which has been forwarded to the user electronically or 
.by hard copy devices such as a .computer disc, flash 
cards, etc. Alternatively, the images may be simply ob- 
tained from a computer file that has been stored or re-, 
ceived. Once the image or images have been retrieved, 
50 then the user would go through each of. the selection 
categories for the desired images and associate the de- 
sired icons with the images. 

[0026] The user may also use the software to search 
and/or re-categorize digital images that have already 
been categorized. The user would identify a group or 
groups of images that have been previously catego- 
rized. Then the selection icons and/or text identifiers for 
.the categories wouJd be used as means for identifying 



9 



EP 1 182 585 A2 



10 



the group and/ or type of images desired. For example, 
if the user wanted all of the images associated with Dad 
and birthday the appropriate icons would be selected 
and the FIND feature would be selected. This would re- 
sult in the images having these associated data being 5 
gathered. The user can then use the grouped images 
as desired. When the user has finished, the image can 
then be returned from where they were obtained. Alter- 
natively, the images may be used to create a new group 
or reorganize existing groups. The user may categorize 10 
and reorganize any or all the images as desired. The 
grouping of the images being limited only by the icons 
and categories available to the user. As previously dis- 
cussed the categories and icons are selected as desired 
by user. 15 
[0027] The user may accept the icons as originally 
provided or select a customized feature whereby per- 
sonalized icons can be added. This can be done at any 
time. Thus, the personal icons could be created initially - 
upon receipt of the software and installed into the com- 20 
puter or they can be created as images are viewed. It is 
desirable to have as many icons initially provided so that 
all the images will have consistent icons for later sorting 
as discussed later herein. However, as new images are 
obtained, there is often a need to provide new and ad- 25 
ditional icons, 

[0028] Referring to Figure 4, there is illustrated a flow ■ 
chart illustrating how additional new icons can be added 
to the current selection categories. In Figure 4, the im- 
age icon may be added during viewing of the images for 30 . 
categorizing. In particularly step 100, a photo is selected 
because the user may realize a new icon is necessary. 
In step 102 after selection of the appropriate button for • 
the adding of a new icon, a portion 200 of the image is 
selected for use as an icon. At this point, portion 200 of 35 
the image may be optionally or automatically saved by 
the program in step 166 or 168 further retaining maxi- 
mum pixel resolution for use in searching and automat- 
ically cataloging images "that have not been cataloged, 
the specifics of which will be discussed later. In the par- 40 
ticuiar embodiment illustrated, a square, representing 
the icon to be created, is placed around the portion 200 
of an image as desired by the user. In step 1 04, the se- ■ 
lected image is properly sized for use as an icon. Then 
the icon is added to the appropriate selection menu. Text *5 
information may be associated with the icon. Step 108 
provides for the typing of text. At step 11 0, a new iden- 
tifier is provided and at step 112; it is added to the list of 
identifiers. These identifiers may of course be associat- 
ed with a particular icon. Alternatively, an icon from a 50 
library supplied with the program or by a third party may 
be added as illustrated by steps 150 - 168. In step 150, 
the user may decide to add an icon supplied by the pro- 
gram as shown in step 152 which is directly added to a 
category or he may choose to connect to a third party 55 
to download an icon from the third party library. The user 
chooses the third party download in step 1 54 by supply- 
ing a universal resource locator (URL) to an internet 



browsersuch as the Internet Explorer browser produced 
by Microsoft Inc. The browser facilitates the network 
connection to the third party library supplier via the in- 
ternet 24. Some libraries might cause the user to incur 
a fee and such information to satisfy payment is supplied 
in step 158. Otherwise, the choice in step 156 leads to 
an icon selection step 160 followed by step 162 for 
downloading the icon using standard internet file trans- 
fer protocol (ftp). The downloaded icon is then added to 
a category in step 164. 

[0029] Referring to Fig. 5A, there is illustrated a mod- 
ified display screen of the software made in accordance 
with the present invention, like numerals indicating like 
items and operations as previously discussed. In this 
embodiment, a plurality of images 120-1 39 are provided 
within window 42 ; In this embodiment, individual imag- 
es, selected groups of images, or all of the images may 
be categorized at the same time. For example, all of the 
images may be categorized as a group. Alternatively, 
groups of images may be categorized. As illustrated by 
Fig. 5B, images 122, 123, 124, 129 and 139 are selected 
for categorization.. Once selected, the appropriated 
icons of the desired categories are selected and asso- 
ciated with the selected images. If desired, the images 
may be selected individually for categorization. This 
system is particularly useful when receiving a plurality 
■of images that were obtained from a single source, for 
example, a roil -of photographic film. Typically, images 
from a single source will have a number of common 
themes among the images. This set-up allows for the 
quick grouping and categorization of the images. Simi- 
larly, when images are retrieved from a storage image 
file or files, the images can be viewed as a group allow- 
ing easier selection and/or reorganization. 
[0030] Once all the images have been appropriately 
categorized and/or reorganized, they are forwarded to 
a device for storage and use. The user may have a va- 
riety of options, for example, the printing, displaying 
and/or transmitting of the images with or without all of 
the associated images. One of the benefits of the 
present invention is that since all of the images have 
associated data in a variety of different fields, the reclas- 
sification and reorganization of these images can be 
done in a quick and easy manner by appropriately build- 
ing a search request for reconstructing a recalling of im- 
ages. In particular, should someone want all of the pic- 
tures of "Grandpa" from a time period to a time period 
taken on birthdays, this could easily be retrieved by en- 
tering of the appropriate information in the appropriate 
selection categories. It can thus be seen that any de- 
sired combination of groupings may be selected by the 
user for recategorizing of the images which can be used 
in a variety of different ways. For example, but not by 
way of limitation, the reorganized images may be sent 
and shared with other third parties over the internet or 
-forwarded to an image service provider for production 
of image products to be delivered as a gift to a third party. 
For example, associated photojmages may be provided 
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as a photo album or album pages which can be sent to 
a third party. For example, images that were taken over 
years of sporting events may be sent to a grandparent 
for their use and review in any desired manner. The 
grouping of images can also be very useful in ordering 
of certain goods and/or services. For example, if album 
pages are being ordered, the grouping of the images by 
desired categories could be a first step in placing the 
image in the desired grouping and order. 
[0031] Thus, it can be seen that the vast library of im- 
ages can now be reaccessed and reorganized as de- 
sired by.the user or any recipient who has access to the 
images. Likewise, the software used for organizing and 
retrieving the images could also be forwarded with the 
images to a third party so that the third party may be 
able to use these images in the same manner as the 
user that forwarded the images. 

[0032] In the particular embodiment illustrated, the 
software program is illustrated as being run on a com- 
puter that the user has direct access. The present in- 
vention is not so limited. For example, the program may 
reside at a remote location, such as a photoservice pro- 
vider that can be accessed over communication links, 
such as the internet/ In such case, the software program 
and maybe even the image to be categorized may be 
stored. 

[0033] In the preceding discussion/ the invention has 
shown the creation and use of the image icons to assist 
the user in the cataloging of images. Referring once 
again to step 166 of Fig. 4, the maximum pixel resolution 
of the portion 200 of the image to be used for an icon 
has been' saved for use in. searching and automatically 
cataloging images that have not been cataloged. In this 
aspect of the invention, the actual image information' 
contained in the pixels comprising portion 200 of the im- 
age or by an analysis of this information resulting in cer- 
tain characteristics of this information is used by the pro- 
gram to search non-cataloged images for : similar or 
nearly matching image information contained in the pix- 
els of the non-cataloged .images. Upon finding such im- 
ages, the program causes the meta data associated 
with the icon created in step 1 06 of Fig. 4 to be appended 
to the newly found images. An example would be that 
an icon of the face of an individual would be created. 
The stored maximum, pixel resolution correlated to the 
created icon would then be analyzed to determine cer- 
tain characteristics. These characteristics would then be 
used to. review non-cataloged images and when images 
. having these characteristics are found, then the icon 
correlated to that face of that individual would be asso- 
ciated therewith. 

[0034] In this application the pixels of the icon are an- 
alyzed for outline patterns. The images to be reviewed 
are analyzed to see if these patterns exist. When a 
match is found this is an indication that the image of the 
icon is present in the reviewed image/Using the forgoing 
technique non-categorized images can be quickly and 
easily cataloged with little or no review by the user. 



Claims 

1 . A computer software product comprising a compu- 
ter readable storage medium having a computer 
5 program which when loaded into a computer of an 

image forming device causes the computer to. per- 
form the following steps: 

displaying at least one image for categoriza- 
10 .. tion; 

providing at least one selection category having 
at least one image association icon that can be 
associated with the image, to be reviewed. 

15 2. A method for organizing a plurality of images com- 
prising the steps of: 

. displaying at least of said plurality of images; 
categorizing said at least one of said plurality 
20 ■• of images using an image icon for at least one 

selection category. 

3. The invention according to claim 1 or 2, wherein 
said at least one selection category comprises'five 
25- selection categories. 

.4.' The. invention according to claim 1 or 2, wherein 
said at least one image icon comprises a plurality - 
of icons. . 
30- : ■ , . - 4 • ' , 

5. The invention according to claim 1 or 2, wherein 
-. said at least one icon is associated with a corre- 
sponding text. . ,.■ 

35 . 6. The invention according to claim 1 or 2, further com- 
prising the step of: . 

providing an additional selection feature for 
adding customized icons. 

40 

. 7. The invention according to claim 6, wherein said 
icon is obtained using the image being categorized. 

8. The invention according to claim 1 or 2, wherein 
45 said at least one selection. category, comprises at 
.least one of the following: 

Who; 
What; ■ 
so / Where; 

When; ' 
Why. 

..9. The invention according to claim. 1 or 2, wherein a 
55 - .; working screen' having a window for displaying of 
said.at least one digital image.and at least one sec- 
. ■ ' , tion area for illustrating said at least one image as- 
sociation icon. 



13 



EP 1 182 535 A2 



14 



10. The invention according to claim 1 or 2, wherein 
said software product further provides the steps of: 

providing for the addition of a new image icon 
for use in categorizing. 

11. The invention according to claim 10, wherein said 
new image icon is obtained from said at least one 
image for categorization. 

12. A computer software product comprising a compu- 
ter readable storage medium having a computer 
program which when loaded into a computer of an 
image forming device causes the- computer to per- 
form the following steps: 

retrieving at least one image from a plurality of 
images" that have been previously categorized; 
providing at least one selection category having 
at least one image association icon that can be 
associated with the image to be reviewed. 

13. A method for retrieving an image from a plurality; of 
images that have been previously categorized, 
comprising the steps of: 

retrieving at least one image fro m;a. plurality of 
images that have been previously categorized-; 
providing at least one selection category having 
at least one image association icon that can be 
associated with the image to be reviewed. . 

14. - A method for automatically organizing a plurality of 

images comprising the steps of: 

providing at least on image icon associated with 
a category,* 

using predetermined characteristics of said 
icon for use in identifying non-categorized im- 
ages for association with said category. 

15. A method according to claim 14, wherein said pre- 
. determined characteristics comprise analyzing the 

pixel content of said image icon. . • ..." . 

16. A computer software product for automatically cat- 
egorizing images comprising a computer readable 
storage medium having a computer program which 
when loaded into a computer of an image forming 
device causes the computer to perform the follow- 
ing steps; 

providing at least on image icon associated with 
a category, 

using predetermined characteristics of said 
icon for use in identifying non-categorized im- 
ages for association with said category. 
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17. A method for personalizing an image computer soft- 
ware program, comprising the steps of: 

a. providing a categorization/retrieval program 
that uses categories and image icons for use in 
categorizing and/or retrieving digital images; 

b. selecting from a plurality of stored categories 
at least one selection category; and 

c. selecting from a plurality of stored image 
icons at least one image icon for use with said 
at least one selection category. 

18. A method according to claim 17, further comprising 
the step of: 

adding a personalized selection category as 
determined by the user. 

19. A method according to claim 17, further comprising 
the step of; 

adding a personalized image icon for use with 
said at least one selection category or said per- 
sonalized category. 

20: A method according to claim 17, further comprising 
the step of automatically adding a new category or 
'--icon to said program in response to information pro- 
vided with" ah* image that is used by said program. 
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